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ABSTRACT 


This  paper  presents  simple  sufficient  conditions  under 
which  the  distribution  of  the  sample  average  shows  increasing 
peakedness  with  Increasing  sample  size#  The  results  are 
actually  more  general,  permitting  a  comparison  of  the 
peakedne3s  of  distributions  of  various  convex  combinations 
of  sample  observations. 


\ 


I. 


INTRODUCTION 


Roughly  speaking,  the  law  of  large  numbers  states  that  under 
mild  restrictions  the  average  of  a  random  sample  has  small  probability 
of  deviating  from  the  population  mean  if  the  sample  size  n  is 
taken  large  enough*  However,  nothing  is  said  abou*-  the  probability 
of  a  given  size  deviation  decreasing  monotonically  as  n  increases* 

In  this  paper  we  develop  conditions  under  which  such  monotonicity 
can  be  established.  Another  way  of  stating  this  is  that  under 
appropriate  conditions  the  ''peakedness  M  of  the  distribution  of 
the  average  of  n  increases  with  n*  We  use  the  definition  of 
peakedness  given  by  Bimbaum  (1948), 

Definition  Let  X^  and  X?  be  real  random  variables  and 
and  a^  real  constants.  We  say  X^  is  more  peaked  about  a^ 
than  X^  about  a^  if 

p[U1  -  ^  |  2  t]  £  P[|X2  -  a2  I  2  t] 

for  all  t  ^  0.  In  the  case  a^  =  0  =  a^,  we  shall  simply  say 
X^  is  more  peaked  than  X^. 

* 

II.  PEAKEDNESS  COMPARISONS  FOR  SIMMETRIC  POLYA  FREQUENCY  FUNCTIONS 

OF  ORDER  2 

Lemma  2*1  Let  f  be  a  Polya  frequency  function  of  order  2 
(PF^),  f(u)  =  f(-u)  for  all  u,  f(u)  >  0  for  -a  <  u  <  a,  and 
G  elsewhere,  0  <  a  £  ®,  X^  and  X^  independently  distributed  with 
density  f,  and  C2(p,t)  =  P[pX^  qX2  £  t],  where  0  ^  p  ^  q, 
p  +  q  =  1*  Then  for  0  <  t  <  a,  Gn(p,t)  is  strictly  increasing 


~> 


in  p,  0  £  p  £  $«, 

Proof  For  0  <  p  <  £,  write  G^Cp^t)  =  J*  F  (u)du. 

Then  -r^  =  f  (u)  (u  -  t)duj  differentiation  under  the 

dP  1*  \  P  / 

integral  sign  is  permissible  since  '  f^~p^f(u)  (u  -  t)  £  Mf(u)  u  -  t 
<»> 

and  f  Mf(u)(u  -  t)du  <  wt  ’where  M  is  the  modal  ordinate  of  f. 


Rewrite 


2  dC? 


t  7t^au\ 

^P  Loo  \  p  / 


f(u)(u  -  t)du  +  f*  f  f(u)(u  -  t ) du • 


Let  v  =  t  -  u  in  the  first  integral  and  v  =  u  -  t  in  the  second 
integral.  We  get 


dG 


(i)  v?  +  v)f(t  -  ^r)  -  f(t  -  v)i'(t  +  ^r))dv 


o 


Tlf(t +  av);(t .  av)d 

V (t  +  qv/p)  fit  -  qv/p)  p  P 


0 


with  the  understanding  that  whenever  a  denominator  is  0  we  use  the 
interrand  in  (l). 

f(t  +  v) 

Next  note  that  when  f  is  PF0,  is  decreasing  in 

t  for  fixed  v  >  0.  Since  t  0,  ^  >  1.  we  have 

*  p  f 


r> 

2  '  2  v  -  ■*-  i  f(v)  f(-v)  \  „/.  ta,./.  avv  , 

(2)  p  ~2 ^  ' rtzmi • {t  *  p,! (t - T’dv* 

No  difficulty  arises  in  case  f(^)  -  0,  since  in  this  case 
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f(t  +  =0.  Thus  the  inequality  remains  valid  if  we  interpret 

the  integrand  in  (2)  as  0  whenever  f(^)  =0,  By  symmetry  of 

2  d^2 

f,  we  conclude  p  ^  0, 

2  dG2 

Now  suppose  p  =  0.  Then  for  all  v,  except  for  at 

most  two  points  (a  PF^  density  is  continuous  except  foret  most 
two  points), 

0  *  f(t+v)f(t  -  “)  -  f(t-v)f(t  +  “)  =  -  fft^?^|}f(t-v)f<t'<,v/p)* 

For  0  <  v  £  ^  ,  f(t  -  v)f(t  -  >  0.  But  since  f  is  symmetric 

PF2,  f  has  a  mode  at  0.  Thus  for  0  <  v  £  £  fft"J'qv/^|  » 

with  equality  possible  only  if  f(u)  is  constant  for 
t  -  tp/q  1  u  ^  t  +  tp/q.  This  last  however  implies  f(u)  is  constant 

for  -a  <  u  <  a,  that  is,  f  is  the  uniform  density.  But  a  direct 

2  dG2 

examination  of  the  uniform  shows  p  -r—  >  0. 

dp 

Finally  note  that  at  p  =  0,  G2(p,t)  is  continuous  by  Cramer 
(1946),  p.  254.  || 


Lemma  2.2  Let  f  be  PF^,  f ( t )  =  f (— t )  for  all  t, 

f(u)  >  0  for  -a  <  u  <  a  and  0  elsewhere,  0  <  a  £  »,  X^,...,Xn 
independently  distributed  with  density  f,  and  - 


PiX.  £  tj,  where  0  £  £  1,  4 


n 


l,...,n,  I  p,  -  1, 


i=l 


p1  +  p  b,  a  positive  constant.  Then  for  0  <  t  <  a,  Gn(p^,t) 

is  strictly  increasinp  in  p,  for  0  ^  p.  £  b/2. 

X  X 


Proof 


Write  G  (p,  ,t)  =  P[pX,  +  qX0  £  t’  -  Y]  where 
n  x  x 
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n  p1 

p  =  p^/b,  q  =  p ^/b,  t'  ~  t/b,  and  Y  =  Z  "jf  X^.  Suppose  Y 
has  density  h.  Since  f  is  symmetric  unimodal,  then  so  i3  h, 
Wintner  (1938), 


OD 

Write  Gn(P^#'t)  =  J*  G0'p,t’  -  y)h(y)dy,  so  that 

.ao 


b 


dG2(p,f  -  y) 
dp 


h(y)dy  . 


Differentiation  under  the  integral  sign  is  permissible  as  before. 
Revri te 


dG  f  t»  dG„(p,t’  -  y)  t  ®  dG5(p,t‘  -  y) 

"^"5 - h(y)dy7  -^“55 - hWdy* 

1  _oo  t  1 


Let  v  =  t*  -  y  in  the  first  integral  and  v  =  y  -  t?  in  the 


second.  Using  the  fact  that 


a°(p.T)  dG>’  ~  v) 


dP 


dP 


we  get 


b 


dG2(p,v) 

dp 


{h(tf  -  v)  -  h(t'  +  v)  )dv. 


Now 

unimodal 


dG„(p,v) 

— -  >  0  for  0  <  v  <  a.  Also  since 

dp 

d'J 

h( t 1  -  v)  >h(t'  +  v).  Thus  - -  >0. 

dpx 


h 


is  symmetric 


dG 

If  -  =  0.  then  h(t*  -  v)  =  h(t’  +  v)  for  all  v  in 

OPt 

(0,a)  except  for  at  most  two  points,  i.e.,  h  is  uniform.  But 

this  implies  a  <  ®.  Thus  h(tf  +  u)  =  0  for  u  >  a  -  t*  so  that 

dG 

h  is  identically  0,  an  obvious  contradiction.  Thus  — -  >  0. 

dpx 
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In  Hardy,  Littlewood,  Polya  (1952),  Chapter  II,  the  concept  of 
majorization  is  defined,  and  its  equivalence  to  several  related 
concepts  is  shown.  A  vector  a  =  (cr^,**»,cr^)  is  said  to  majorize 
a  vector  a'  =  (arj,*«»,or^)  (written  a  >  2’)  if  the  components 
can  be  arranged  so  that 

n  n 

(i)  2®i  * 

i=l  1=1 


(ii) 


^  cr  ^  0 


*{ 


*•4 


L.  n 


o; 


(iii) 


i  i 

^  2aj  for  1  ^ 1  ^ n* 

j=i  j=i 


A  linear  transformation  T  of  a  is  defined  as  follows. 
Consider  a  pair  cr^,  a ^  with  >  ar^;  write 

ak  =  P  +  T>  ~  P  _T 

If  0  6  <  t,  then  T  is  defined  by 


t  +  S 
2t 


or. 


+ 


T  -  b 

2t 


p  +  6 


a 


l 


T  -  6 

2t  ak 


+ 


T  +  6 

2t 


P  “ 


b 


«j  =  ®j(J  ^  k>  j  /  *)• 
=  Itr. 


we  write  a' 
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Hardy,  Littlewood,  Polya  show  that  a  necessary  and  sufficient 
condition  that  a  >  a'  but  a  is  not  identical  with  a'  ls  that 
a'  can  be  derived  from  or  by  a  finite  number  of  transformations 

T. 

A  third  concept  is  that  of  forming  averages.  We  say  Of'  is 
an  average  of  a  if  there  exist  ^  0,  i  =  l»***>n, 

j  =  1, • • • ,n,  such  that 

n  n 

i---l  J=1 


and  orj  =  ^p,  i  =  l,*“>n* 

J=1 

Hardy,  Littlewood,  Polya  show  that  a  necessary  and  sufficient  condi¬ 
tion  that  a'  should  be  an  average  of  a  is  that  a  >  a1. 


Theorem  2.1  Let  f  be  PF ^ >  f(t)  -  f(-t)  for  all  t, 
f(t)  >  0  for  -a  <  t  <  a  and  0  elsewhere,  0  <  a  £  00 , 


independently  distributed  with  density  f,  H(t)  -  p| 

,  p '  not 


identical 
H'(t)  >  H(t). 


>V1  £  ‘1 

>  2  >  2*; 

a  „  J 

n 

S’*- 

u 

cH 

5=1 

i=i 

g’A  « *]' 


.  Then  for  0  <  t  <  a, 


Proof  21  can  be  obtained  from  p  by  a  finite  number  of  T 
transformations.  Applying  Lemma  2  as  many  times,  we  obtain  the 
desired  conclusion.  || 


We  may  define  a  continuous  version  of  majorization.  Let 


7 


(i)  J*  h(t)dt  =  J*  h'(t)dt,  where  a  and/or  b  may  be 
a  a 

infinite; 


(ii)  h(t) ,  h*(t)  be  nonnegative  and  decreasing  for  a  <  t  <  b; 


(iii)  J*  h(t)dt  ^  J*  h»(t)dt  for  a  <  x  <  b. 

a  a 

Then  we  say  that  h  majorizes  h'  on  La,b], 


In  Theorem  2.1  if  we  let  h  and  h’  be  the  densities 

corresponding  to  the  distribution  functions  H  and  H',  then  we 

see  that  the  conclusion  of  the  theorem  states  that  h'  majorizes 
h  on  [O,00).  Thus  majorization  in  the  weights  of  the  convex 
combination  of  random  variables  carries  over  into  majorization  in 
the  resulting  densities  (though  in  the  reverse  direction). 


Corollary  2.1  Let  f  be  PF2»  f(t)  --  f(-t)  for  all  t, 
f(t)  >  0  for  -a  <  t  <  a  and  0  elsewhere,  0  <  a  £  °°,  X^X^*** 
independently  distributed  with  density  f.  Then  for  0  <  t  <  a, 


in  n  =  1,2,’ 


n)(nt)  =  E  Xi  £  tl  is  strictly  increasing 

Proof  Note  that  £  =  n,*’*’n,C^  £  (  n+l’n-KL’* 

t—  — i— J  where  each  vector  contains  n  +  1  components.  Thus 

n+l’n+l/’ 

Theorem  2.1  immediately  yields  the  desired  conclusion. 


In  words,  for  symmetric  PF2  densities  peakedness  of  means 
increases  with  sample  size. 

We  can  extend  the  class  of  densities  for  which  the  conclusion 
of  Theorem  2.1  and  consequently  that  of  Corollary  2.1  applies  as 
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follows.  First  we  prove 


T.flmmfl  Let  fA(t)  =  fA(-t)  for  all  t,  f^t)  >  0,  and 

decreasing  for  0  <  t  <  a  and  0  elsewhere,  0  <  a  £  »,  i  =  1,2. 

Let  X1,***,Xn  be  independently  distributed  with  density  f^ 

Y  be  independently  distributed  with  density  f„.  Suppose 

1  K  _n_  JL  A 

E  >  p'  implies  ^p^  more  peaked  than  511(1  ^PiYi 

i=l  >.  . 

more  peaked  than  ^en  £  ^  2 

implies  ^p1(X1  +  Yi)  1=1  more  peaked  than  ^pi(Xi  +  V* 

n  n  n  n 

Proof  VPiXi>  2PiYi’2P^'  “d  2?lYi  are3ymmetriC 

&  m  1=1  ~ 

unimodal  random  variables,  Wintner  (1938).  Hence  by  the  lemma  of 
Birnbaum  (1948)  the  result  follows.  | 

Note  that  if  X^,*»*>Xr  are  independently  distributed  with 

Cauchy  density  g  (x)  =  —  *  2  2S  a  >  C»  then  APiXi^°  ^  Pi  <  lf 

a  ti(1  +  a  x  )  ^ 

n 

^pi  =  1)  is  distributed  with  the  same  density.  Mote  too  that  if 

ftl 

X1  and  X2  are  independent  Cauchy  variates  with  corresponding 

densities  g  and  g  ,  then  +  X_  is  also  a  Cauchy  variate 

al  a2 

with  density  g  for  appropriate  a.  We  may  now  state 

Theorem  2.2  Let  f  be  FF2,  with  f(t)  =  f(-t), 
f(t)  >  0  for  -a  <  t  <  a  and  0  elsewhere,  0  <  a  <  “.  Let 
X-L,..*,Xn  be  independently  distributed  with  density  f  *  gfi, 


H(t)  =  P 


a  n 

[5/ixi  S  ‘].  H'(t)  =  p[Yp}X,  *  ‘] 


2  >  E'»  2,  E' 
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not  identical. 


H'(t)  >  H(t). 


Then  for  0  <  t  <  a, 


Proof  From  Lemma  2.3  It  follows  that  H*(t)  Ii(t). 
Strictness  follows  from  the  fact  that  corresponding  strictness 
holds  for  the  PF2  component  of  the  convolution.  || 

Thus  Theorem  2.1  holds  when  the  underlying  density  is  the 
convolution  of  a  symmetric  PF,,  density  and  a  Cauchy  density. 


It  is  worthwhile  to  consider  symmetric  distributions  for  which 

the  conclusions  of  Theorem  2.1  do  not  hold.  One  such  is  the  Cauchy 

distribution  with  density  f(x)  =  - &  2  2  i  it  represents  a 

tt(1  +  a  x  ) 

" boundary"  distribution  in  that  if  • >X^  sxe  independently 

n 


distributed  with  density  f,  then 


P^,  p±  ^  0,  i  =  — 


n 

^p.  =  1,  also  has  Cauchy  density  f.  We  can  actually  produce  a 

i=l 

distribution  G  such  that  if  Y^,  Y2  are  independently  distributed 
with  distribution  G,  then  for  0  <  t  <  00 


G(2)(2t)  =  P[fY1  +  fY2  <  t]  <  P[Y1  ^  t]  =  G(t). 


?./■  Let  X0  be  independently  distributed  with 

density  f(x)  =  - a  r  .  Let  0(x)  be  strictly  convex  and 

n(l  +  ax) 

increasing  for  0  £  x  <  00  and  0(x)  =  -  0  (-x)  for  all  x.  Define 
Y  -  0(X^ ) ,  i  =  1,2.  Then  for  t  >  0  P^  +  £  t]  <  P^  £  t] . 

Proof  For  X2  £  0  but  not  both  0,  0(^0^  +  £X2)  <  g0(X1) 

+  ^(X^.  By  symmetry  for  X^,  X2  £  0  but  not  both  0, 
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10(2^  +  tX2)|  <  i«0(X1)  +  ?0(X2)|.  For  ^  £  0,  X2  >  0, 

] X^|  <  we  have  0(S^]_  +  =  ^^X2  “  X1‘^  ^  ^vX2  “  ^!  ' 

£  40(X2)  -  |0(|X1|)  =  «0(X1)  +  t0(X2).  3y  symmetry,  for  X1  <  C, 

x2  *  o,  |xj  >  x2,  \m\  +  **2)l  <  itf<*i>  +  ^0(x2)i*  Thus  for  ' 
all  tj,  X0  for  which  +  X,  ^  0,  |  0^  +  fiX2)  |  <  lt0(X]_)  +  ?0(x2)  i  • 

3ut  fX-,  +  fX2  has  the  same  distribution  as  X^.  Thus  jT-J 
is  strictly  stochastically  smaller  than  IfcYj.  +  fcY2l  by  Lemma  1* 
page  73,  of  Lehmann  (1959).  The  result  follows.  || 

Thus  the  distribution  of  the  mean  of  two  is  actually  less 
peaked  than  that  of  a  single  random  variable.  In  analogous  fashion 
we  may  show 

r.pmmfl  2.5  Let  Xx,  X2  be  independently  distributed  with 

density  f(x)  =  a  .  Let  0(x)  be  strictly  concave  and 

1  2  2) 

increasing  for  0  £  x  <  »  and  0(x)  =  -  0 (-x)  for  all  x.  Deiine 
y  =  0(Xi),  i  =  1,2.  Then  for  t  >  0,  ^  >  P^Y1  ^  ^  * 

Note  tbat  a  very  strong  form  of  stochastic  comparison  is 
involved,  since  for  each  sample  outcome  in  Lemma  2.3,  (2.4), 

|  y|  <0)1^  f  ^y^l  .  It  does  not  seem  possible  to  use  the  same 
method  to  obtain  stochastic  comparisons  between  averages  of  n  and 
n  +  1  variables  for  n  >  1.  However,  using  Birnbaum's  lemma  we 
can  obtain  stochastic  comparisons  between  averages  of  2  and 
2^+^  variables,  n  =  1,2, •••  • 
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